Search for: All records

Pedagogical agents (PAs) are increasingly being integrated into educational technologies. Although previous reviews have examined the impact of PAs on learning and learning-related outcomes, it still remains unclear what specific design features, social cues, and other contextual elements of PA implementation can optimize the learning process. These questions are even more prevalent with regards to the K-12 population, as most reviews to date have largely focused on post-secondary learners. To address this gap in the literature, we systematically review empirical studies around the design of PAs for K-12 learners. After reviewing 1374 studies for potential inclusion, we analyzed 44 studies that met our inclusion criteria using Heidig and Clarebout’s (2011) frameworks. Our findings showed that learners had preferences for specific types of PAs. While these preferences were not always associated with increased learning outcomes, there is a lack of research specifically investigating the intersection of perceptions and learning. Our results also showed that pedagogical strategies that are effective for human teachers were effective when used by PAs. We highlight what specific design features instructional designers can use to design PAs for K-12 learners and discuss promising research directions based on the extant work in the field. 

Systematic reviews are a time-consuming yet effective approach to understanding research trends. While researchers have investigated how to speed up the process of screening studies for potential inclusion, few have focused on to what extent we can use algorithms to extract data instead of human coders. In this study, we explore to what extent analyses and algorithms can produce results similar to human data extraction during a scoping review—a type of systematic review aimed at understanding the nature of the field rather than the efficacy of an intervention—in the context of a never before analyzed sample of studies that were intended for a scoping review. Specifically, we tested five approaches: bibliometric analysis with VOSviewer, latent Dirichlet allocation (LDA) with bag of words, k-means clustering with TF-IDF, Sentence-BERT, or SPECTER, hierarchical clustering with Sentence-BERT, and BERTopic. Our results showed that topic modeling approaches (LDA/BERTopic) and k-means clustering identified specific, but often narrow research areas, leaving a substantial portion of the sample unclassified or in unclear topics. Meanwhile, bibliometric analysis and hierarchical clustering with SBERT were more informative for our purposes, identifying key author networks and categorizing studies into distinct themes as well as reflecting the relationships between themes, respectively. Overall, we highlight the capabilities and limitations of each method and discuss how these techniques can complement traditional human data extraction methods. We conclude that the analyses tested here likely cannot fully replace human data extraction in scoping reviews but serve as valuable supplements. 

Over the past three decades the field of pedagogical agents (PAs) has seen significant growth, but no review has specifically focused on the design and use of PAs for K-12 students, despite the fact that an early meta-analysis showed that they receive the most benefits from learning from or with PAs. Our systematic search revealed 112 studies that met the inclusion criteria and were analyzed. Our findings revealed a plethora of studies investigating the use of PAs with K-12 populations and a considerable number of longitudinal studies, both of which the field has long stated did not exist in significant numbers. Our findings contrast long-held findings in the field, further support others, and highlight areas where further experimentation and research synthesis are needed. 

Abstract This paper is part of the special issue on Teacher Learning and Practice within Organizational Contexts. Shifting instructional practices in elementary schools to include more equitable, reform‐based pedagogies is imperative for supporting students’ development as science learners. Teachers need high quality professional development (PD) to learn such practices, but research shows considerable variability in the extent to which teachers implement instructional practices learned during PD. Individual teacher characteristics such as self‐efficacy may influence teacher learning during PD, but only account for part of the variability. The organizational conditions of teachers’ schools and districts may also play a key role in teachers’ implementation of new instructional practices. However, because systematic research in this area in science education is still nascent, it is difficult for districts and PD providers to address organizational barriers to professional learning. To meet this need, we conducted an explanatory mixed‐methods study using surveys (N = 54) and interviews (N = 19) of elementary teachers engaged in equity‐focused, reform‐based science PD, testing the degree to which a conceptually framed set of organizational conditions predicted teacher equity self‐efficacy and instructional practice alignment. Out of the 11 organizational conditions, only teacher professional impact and their sense of autonomy in their instructional practice explained variance in the outcomes. Qualitative findings showed these relationships to be iterative and recursive, rather than linear. Our findings underscore the essential role of teacher professionalism and sense of agency over commonly cited organizational conditions such as materials and labs in supporting teachers to implement more equitable science instructional practices during PD. 

Successful women role models can be—but are not always—effective in increasing pursuit of science, technology, engineering, and mathematics (STEM) careers among girls. What makes a woman role model motivating for young girls? An experimental study (N = 205 girls aged 5–8 years; 42.0% girls of color) investigated the effects of a role model’s messages about her own ability and interest. The model portrayed her ability and interest as quantities that developed over time (a growth mindset) or that had always been present (a fixed mindset). The role model’s growth (vs. fixed) mindset messages about ability—but not interest—increased girls’ interest and self-efficacy in the scientist’s field, but these effects were observed only among girls of color (ds = 0.56 and 0.65 for interest and self-efficacy, respectively). The findings contribute to theory on role models and growth mindsets, and they also have implications for the design of effective role model interventions.